Method of printing regions larger than the print swath using a handheld printer

ABSTRACT

A method of printing comprising the steps of: (i) operatively positioning a swipe printer relative to a surface and swiping the printer across the surface; (ii) printing, during the swipe, successive parts of a position-coding pattern onto the surface; (iii) printing, during the swipe, successive parts of a graphic image onto the surface, the position-coding pattern and the graphic image being superimposed; (iv) imaging, during the swipe, portions of the surface on which the printhead has printed the parts of the position-coding pattern; (v) determining, during the swipe, absolute positions of the printhead using imaged parts of the position-coding pattern; and (vi) using the absolute positions to control, during the swipe, printing of the position-coding pattern and the graphic image.

CROSS-REFERENCE TO RELATED PATENT APPLICATIONS

The present application claims the right of priority under 35 U.S.C. §119(e) based on U.S. Provisional Patent Application No. 60/953,443 filedon Aug. 1, 2007 and U.S. Provisional Patent Application No. 60/974,077,filed Sep. 21, 2007 which is incorporated by reference herein in itsentirety as if fully set forth herein.

FIELD OF INVENTION

The present invention relates to a swipe printer and a swipe scanner. Ithas been developed primarily for improving the accuracy andfunctionality of swipe-printing and/or swipe-scanning.

CO-PENDING APPLICATIONS

The following applications have been filed by the Applicantsimultaneously with the present application:

NPT087US NPT088US NPT089US NPT090US NPT092US NPT093US NPT094US NPT095USNPT096US NPT097US NPS151US NPP090US NPP091US NPP092US NPP093US NPP095USNPP096US NPP097US NPS149US NPS150US NPZ032US NPZ033US NPP099US NPP100USNPP101US NPP102US NPP103US NPP104US NPP105US NPP106US NPP107US NPP108USThe disclosures of these co-pending applications are incorporated hereinby reference. The above applications have been identified by theirfiling docket number, which will be substituted with the correspondingapplication number, once assigned.

CROSS REFERENCES

The following patents or patent applications filed by the applicant orassignee of the present invention are hereby incorporated bycross-reference.

10/815621 10/815635 10/815647 11/488162 10/815636 11/041652 11/04160911/041556 10/815609 7204941 7278727 10/913380 7122076 7156289 09/5751976720985 7295839 09/722174 7068382 7094910 7062651 6644642 65499356987573 6727996 6760119 7064851 6290349 6428155 6785016 6831682 67418716965439 10/932044 6870966 6474888 6724374 6788982 7263270 67882936737591 09/693514 10/778056 10/778061 11/193482 7055739 6830196 71822477082562 10/409864 7108192 10/492169 10/492152 10/492168 10/4921617308148 6957768 7170499 11856061 11/672522 11/672950 11754310 120155077148345 12025746 12025762 12025765 10/407212 6902255 6755509

BACKGROUND

The Applicant has previously described a method of enabling users toaccess information from a computer system via a printed substrate e.g.paper. The substrate has a coding pattern printed thereon, which is readby an optical sensing device when the user interacts with the substrateusing the sensing device. A computer receives interaction data from thesensing device and uses this data to determine what action is beingrequested by the user. For example, a user may make handwritten inputonto a form or make a selection gesture around a printed item. Thisinput is interpreted by the computer system with reference to a pagedescription corresponding to the printed substrate.

It would desirable to provide a convenient means for printing and/orscanning interactive pages of this type. It would further be desirableto provide a means for conferring interactivity onto ‘normal’pre-printed graphic images.

SUMMARY OF INVENTION

In a first aspect the present invention provides a swipe printercomprising:

-   -   a printhead for printing a graphic image and a position-coding        pattern onto a surface;    -   an ink supply containing at least one first ink for printing the        graphic image and a second ink for printing the position-coding        pattern;    -   at least one first image sensor positioned for imaging portions        of said surface on which said printhead has printed during a        swipe of the surface, each imaged portion containing part of the        position-coding pattern printed by said printhead during said        swipe; and    -   a processor for determining absolute positions of the swipe        printer using said parts of the position-coding pattern,        wherein the processor is configured to use the absolute        positions for controlling an output of said printhead during        said swipe.

Optionally, said second ink is an infrared-absorbing ink.

Optionally, the or each first ink has an infrared window enabling saidfirst image sensor to image said position-coding pattern in the presenceof the first ink.

Optionally, the swipe printer is configured for unidirectional swiping.

Optionally, said first image sensor is positioned downstream of saidprinthead, wherein a swipe direction is defined as upstream.

Optionally, the swipe printer further comprising a motion sensor forsensing relative motion of the printer.

Optionally, said processor is configured to use the sensed relativemotion together with said absolute positions to control the output ofthe said printhead.

Optionally, said position-coding pattern further identifies anorientation of position data relative to a grid containing said positiondata.

Optionally, said processor is configured to use said part of theposition-coding pattern to determine an orientation of the printerrelative to said grid, and to use said orientation together with saidabsolute position to control the output of the said printhead.

Optionally, said position-coding pattern further identifies animpression identity associated with said graphic image.

Optionally, the swipe printer, further comprising a first memory forstoring a plurality of impression identities, each stored impressionidentity being associable with a graphic image.

Optionally, the swipe printer, further comprising communication meansfor communicating with a computer system.

Optionally, said processor is configured to generate association datafor communication to the computer system, said association dataindicating an association between the impression identity and thegraphic image such that said graphic image printed by said printer isinteractive.

Optionally, said association data enables said computer system toassociate one or more zones of the graphic image with a correspondinginteractive element.

Optionally, said interactive element is selected from the groupcomprising: a hyperlink, an input field and a button.

Optionally, the swipe printer, further comprising a second image sensorconfigured for scanning the graphic image printed by said printer.

Optionally, said second image sensor is positioned parallel and/orsubstantially coextensive with said printhead.

Optionally, said printhead is configured for printing the graphic imageand the position-coding pattern substantially simultaneously onto saidsurface during said swipe.

In a further aspect there is provided a handheld device comprising theswipe printer.

In a further aspect there is provided a handheld device, which isselected from the group comprising: a mobile phone and a personaldigital assistant.

In a second aspect the present invention provides a swipe scannercomprising:

-   -   a printhead for printing a position-coding pattern onto a        surface;    -   an ink supply containing an ink for printing the position-coding        pattern;    -   at least one first image sensor positioned for imaging portions        of said surface on which said printhead has printed during a        swipe of the surface, each imaged portion containing part of the        position-coding pattern printed by said printhead during said        swipe;    -   at least one second image sensor for capturing, during said        swipe, portions of a graphic image pre-printed on said surface;        and    -   a processor configured for:        -   determining absolute positions of the swipe scanner using            said parts of the position-coding pattern;        -   using the absolute positions to control an output of said            printhead during said swipe; and        -   using the absolute positions to assemble said captured            portions of said graphic image into a scanned graphic image.

Optionally, said ink is an infrared-absorbing ink.

Optionally, said graphic image is printed with one or more colored inkshaving an infrared window, thereby enabling imaging of saidposition-coding pattern in the presence of said colored inks.

Optionally, the swipe scanner is configured for unidirectional swiping.

Optionally, said first image sensor is positioned downstream of saidprinthead, wherein a swipe direction is defined as upstream.

In another aspect the swipe scanner further comprising a motion sensorfor sensing relative motion of the scanner.

Optionally, said processor is configured to use relative motion datatogether with said absolute positions to control the output of the saidprinthead and to assemble said captured portions.

Optionally, said position-coding pattern further identifies anorientation of position data relative to a grid containing said positiondata.

Optionally, said processor is configured to use each part of theposition-coding pattern to determine an orientation of the scannerrelative to said grid, and to use said orientation together with saidabsolute position to control the output of the said printhead and toassemble said captured portions.

Optionally, said position-coding pattern further identifies animpression identity associated with said graphic image.

In a further aspect the swipe scanner further comprising a first memoryfor storing a plurality of impression identities, each stored impressionidentity being associable with a graphic image.

In another aspect the swipe scanner further comprising communicationmeans for communicating with a computer system.

Optionally, said processor is configured to generate association datafor communication to the computer system, said association dataindicating an association between the impression identity, the absolutepositions and the scanned graphic image, such that said graphic imagescanned by said printer is interactive.

Optionally, said association data enables said computer system toassociate one or more zones of the graphic image with a correspondinginteractive element.

Optionally, said interactive element is selected from the groupcomprising: a hyperlink, an input field and a button.

Optionally, said second image sensor is a linear image sensor.

Optionally, said second image sensor is positioned parallel and/orsubstantially coextensive with said printhead.

In another aspect there is provided a handheld device comprising theswipe printer

In a further aspect the handheld device is selected from the groupcomprising: a mobile phone and a personal digital assistant.

In a third aspect the present invention provides a swipe scanner forscanning a graphic image pre-printed on a surface, said swipe scannercomprising:

-   -   a printhead for printing a position-coding pattern onto said        graphic image, said position-coding pattern identifying a        plurality of absolute positions and an impression identity for        the graphic image;    -   an ink supply containing an ink for printing the position-coding        pattern;    -   at least one first sensor for sensing positions of said scanner        during a swipe of the surface;    -   at least one second image sensor for capturing, during said        swipe, portions of the graphic image; and    -   a processor configured for:        -   using the sensed positions to control an output of said            printhead during said swipe;        -   using the sensed positions to assemble said captured            portions of said graphic image into a scanned graphic image;            and        -   generating association data indicating an association            between the impression identity, the plurality of absolute            positions and the scanned graphic image.

Optionally, said first sensor comprises an image sensor positioned forimaging portions of said surface on which said printhead has printedduring a swipe of the surface, each imaged portion containing part ofthe position-coding pattern printed by said printhead during said swipe.

Optionally, said first image sensor is positioned downstream of saidprinthead, wherein a swipe direction is defined as upstream.

Optionally, said first sensor comprises a relative motion sensor.

Optionally, said first sensor comprises an optical mouse sensor.

Optionally, said ink is an infrared-absorbing ink.

Optionally, said graphic image is printed with one or more colored inkshaving an infrared window, thereby enabling imaging of saidposition-coding pattern in the presence of said colored inks.

Optionally, the swipe scanner further comprising a first memory forstoring a plurality of impression identities, each stored impressionidentity being associable with a graphic image.

Optionally, said ink supply comprises said first memory.

Optionally, the swipe scanner further comprising communication means forcommunicating with a computer system.

Optionally, said association data enables said computer system toassociate one or more zones of the graphic image with a correspondinginteractive element.

Optionally, said interactive element is selected from the groupcomprising: a hyperlink, an input field and a button.

Optionally, said computer system is configured for:

-   -   (i) performing Optical Character Recognition (OCR) on the        scanned graphic image to convert text images into computer text;    -   (ii) generating an input description for said scanned graphic        image, said input description describing words of computer text        and zones of corresponding text images in the scanned graphic        image; and    -   (iii) storing a page description comprising said input        description and said scanned graphic image, said page        description being indexed with said impression identity,        wherein said page description is retrievable so as to confer        interactivity on the graphic image.

Optionally, said computer system is further configured for:

-   -   identifying URI text strings in the computer text; and    -   generating the input description further describing a URI and a        zone of a corresponding URI text string in the scanned graphic        image.

Optionally, said second image sensor is a linear image sensor.

Optionally, said second image sensor is positioned parallel and/orsubstantially coextensive with said printhead.

Optionally, is manually-swipable or robotically swipable.

In a further aspect there is provided a handheld device comprising theswipe printer.

In another aspect the handheld device is selected from the groupcomprising: a mobile phone and a personal digital assistant.

In a fourth aspect the present invention provides a swipe scanner forscanning a graphic image printed on a surface, said surface having aposition-coding pattern imposed with the graphic image, said swipescanner comprising:

-   -   at least one first image sensor positioned for imaging portions        of said surface during a swipe of the surface, each imaged        portion containing part of the position-coding pattern;    -   at least one second image sensor for capturing, during said        swipe, portions of the graphic image; and    -   a processor configured for:        -   determining absolute positions of the swipe scanner using            said parts of the position-coding pattern; and        -   using the absolute positions to assemble said captured            portions of said graphic image into a scanned graphic image.

Optionally, swipe scanner further comprising a motion sensor for sensingrelative motion of the scanner.

Optionally, said processor is configured to use relative motion datatogether with said absolute positions to assemble said captured portionsinto said scanned image.

Optionally, said motion sensor comprises said first image sensor.

Optionally, said motion sensor is an optical mouse sensor.

Optionally, said position-coding pattern further identifies anorientation of position data relative to a grid containing said positiondata.

Optionally, said processor is configured to use each part of theposition-coding pattern to determine an orientation of the scannerrelative to said grid, and to use said orientation together with saidabsolute position to assemble said captured portions.

Optionally, said position-coding pattern further identifies an identity,said identity identifying said graphic image, said surface or a regionof said surface.

Optionally, the swipe scanner further comprising communication means forcommunicating with a computer system.

Optionally, said second image sensor is a linear image sensor.

Optionally, said second image sensor extends substantially a width ofsaid scanner.

In a further aspect there is provided a handheld device comprising theswipe printer.

In another aspect the handheld device is selected from the groupcomprising: a mobile phone and a personal digital assistant.

In a fifth aspect the present invention provides a method of printingcomprising the steps of:

-   -   (i) operatively positioning a swipe printer relative to a        surface and swiping the printer across the surface;    -   (ii) printing, during said swipe, successive parts of a        position-coding pattern onto said surface;    -   (iii) printing, during said swipe, successive parts of a graphic        image onto the surface, said position-coding pattern and said        graphic image being superimposed;    -   (iv) imaging, during said swipe, portions of said surface on        which said printhead has printed said parts of the        position-coding pattern;    -   (v) determining, during said swipe, absolute positions of the        printhead using imaged parts of the position-coding pattern; and    -   (vi) using the absolute positions to control, during said swipe,        printing of the position-coding pattern and the graphic image.

Optionally, said printhead prints the graphic image and theposition-coding pattern substantially simultaneously onto said surface.

Optionally, said surface is blank in step (i), and wherein an initialposition of said swipe printer provides a reference point for saidposition-coding pattern.

Optionally, said reference point is an origin.

Optionally, said origin is based on an assumed initial swipe directionin step (i).

Optionally, said origin is a top-left corner of the position-codingpattern, and said initial swipe direction is a left-to-right swipe or atop-to-down swipe.

Optionally, step (i) further comprises the sub-steps of:

-   -   imaging part of a position-coding pattern printed during a        previous swipe of the printer; and    -   determining an absolute position of the printhead,        wherein said imaged part of the position-coding pattern is        contained in an outer perimeter of the position-coding pattern        printed during the previous swipe.

Optionally, said swiping comprises swiping outwardly from said outerperimeter.

Optionally, said graphic image is printed with at least one first inkand said position-coding pattern is printed with a second ink.

Optionally, said second ink is an infrared-absorbing ink.

Optionally, said printer is configured for unidirectional swiping.

Optionally, said printer comprises a first image sensor for imaging saidposition-coding pattern, said first image sensor being positioneddownstream of a printhead, wherein a swipe direction is defined asupstream.

I a further aspect there is provided a method further comprising thesteps of:

-   -   sensing relative motion of the printer during the swipe to        generate relative motion data; and    -   using the sensed relative motion together with said absolute        positions to control printing of the position-coding pattern and        the graphic image.

Optionally, the method further comprising the steps of:

-   -   sensing an orientation of the printer relative to the        position-coding pattern;    -   using the orientation together with said absolute positions to        control printing of the position-coding pattern and the graphic        image.

Optionally, the method further comprising the steps of:

-   -   accessing an impression identity for said graphic image;    -   associating said impression identity with said graphic image;    -   generating association data indicating an association between        the impression identity, the absolute positions and the graphic        image; and    -   communicating said association data to a computer system.

Optionally, the printed position-coding pattern further identifies saidimpression identity.

Optionally, said association data enables said computer system toassociate one or more zones of the graphic image with a correspondinginteractive element.

Optionally, said interactive element is selected from the groupcomprising: a hyperlink, an input field and a button.

Optionally, said impression identity is accessed from any one of:

-   -   a memory in said printer, said memory storing a plurality of        impression identities; and    -   a computer system communicating with said printer.

Optionally, said printer is contained in a mobile phone or personaldigital assistant.

In a sixth aspect the present invention provides a method ofswipe-scanning a graphic image pre-printed on a surface, said methodcomprising the steps of:

-   -   (i) operatively positioning a swipe scanner relative to the        surface and swiping the scanner across the surface;    -   (ii) capturing, during said swipe, successive images of portions        of the graphic image;    -   (iii) printing, during said swipe, successive parts of a        position-coding pattern onto the surface, said position-coding        pattern being superimposed with said graphic image;    -   (iv) imaging, during said swipe, portions of said surface on        which said printhead has printed said parts of the        position-coding pattern;    -   (v) determining absolute positions of the scanner using the        imaged parts of the position-coding pattern; and    -   (vi) using the absolute positions to assemble said captured        portions of said graphic image into a scanned graphic image.

Optionally, an initial position of said swipe scanner provides areference point for said position-coding pattern.

Optionally, said reference point is an origin.

Optionally, said origin is based on an assumed initial swipe directionin step (i).

Optionally, said origin is a top-left corner of the position-codingpattern, and said initial swipe direction is a left-to-right swipe or atop-to-down swipe.

Optionally, step (i) further comprises the sub-steps of:

-   -   imaging part of a position-coding pattern printed during a        previous swipe of the scanner; and    -   determining an absolute position of the scanner,        wherein said imaged part of the position-coding pattern is        contained in an outer perimeter of the position-coding pattern        printed during the previous swipe.

Optionally, said swiping comprises swiping outwardly from said outerperimeter of said pre-printed position-coding pattern.

Optionally, said graphic image is printed with at least one first inkand said position-coding pattern is printed with a second ink.

Optionally, said second ink is an infrared-absorbing ink.

Optionally, the or each first ink has an infrared window enablingimaging of said position-coding pattern in the presence of the firstink.

Optionally, said scanner is configured for unidirectional swiping.

Optionally, said scanner comprises a first image sensor for imaging saidposition-coding pattern, said first image sensor being positioneddownstream of a printhead, wherein a swipe direction is defined asupstream.

Optionally, the method further comprising the steps of:

-   -   sensing relative motion of the scanner during the swipe to        generate relative motion data; and    -   using the relative motion data together with said absolute        positions to assemble said scanned graphic image.

Optionally, the method further comprising the steps of:

-   -   sensing an orientation of the scanner relative to the        position-coding pattern;    -   using the orientation together with said absolute positions to        assemble said scanned graphic image.

Optionally, the method further comprising the steps of:

-   -   accessing an impression identity for said graphic image;    -   associating said impression identity with said graphic image;    -   generating association data indicating an association between        the impression identity, the absolute positions and the graphic        image; and communicating said association data to a computer        system.

Optionally, the printed position-coding pattern further identifies saidimpression identity.

Optionally, said association data enables said computer system toassociate one or more zones of the graphic image with a correspondinginteractive element.

Optionally, said interactive element is selected from the groupcomprising: a hyperlink, an input field and a button.

Optionally, said impression identity is accessed from any one of:

-   -   a memory in said scanner, said memory storing a plurality of        impression identities; and    -   a computer system communicating with said scanner.

Optionally, said scanner is contained in a mobile phone or personaldigital assistant.

In a seventh aspect the present invention provides a method ofswipe-scanning a graphic image pre-printed on a surface, said methodcomprising the steps of:

-   -   (i) operatively positioning a swipe-scanner relative to the        surface and swiping the scanner across the surface;    -   (ii) capturing, during said swipe, successive images of portions        of the graphic image;    -   (iii) printing, during said swipe, successive parts of a        position-coding pattern onto said graphic image, said        position-coding pattern identifying a plurality of absolute        positions and an impression identity for the graphic image;    -   (iv) sensing, during said swipe, positions of said scanner;    -   (v) using the sensed positions to control, during said swipe,        printing of the position-coding pattern;    -   (vi) using the sensed positions to assemble said captured        portions of said graphic image into a scanned graphic image; and    -   (vii) generating association data indicating an association        between the impression identity, the plurality of absolute        positions and the scanned graphic image.

Optionally, said positions of said scanner are sensed using a firstimage sensor positioned for imaging portions of said surface on whichsaid printhead has printed during a swipe of the surface, each imagedportion containing part of the position-coding pattern printed by saidprinthead during said swipe.

Optionally, said first image sensor is positioned downstream of saidprinthead, wherein a swipe direction is defined as upstream.

Optionally, said positions of said scanner are sensed using a relativemotion sensor.

Optionally, said positions of said scanner are sensed using an opticalmouse sensor.

Optionally, an initial position of said swipe scanner provides areference point for said position-coding pattern.

Optionally, said reference point is an origin.

Optionally, said origin is based on an assumed initial swipe directionin step (i).

Optionally, said origin is a top-left corner of the position-codingpattern, and said initial swipe direction is a left-to-right swipe or atop-to-down swipe.

Optionally, step (i) further comprises the sub-steps of:

-   -   imaging part of a position-coding pattern printed during a        previous swipe of the scanner; and    -   determining an absolute position of the scanner,        wherein said imaged part of the position-coding pattern is        contained in an outer perimeter of the position-coding pattern        printed during the previous swipe.

Optionally, said swiping comprises swiping outwardly from said outerperimeter of said pre-printed position-coding pattern.

Optionally, the method further comprising the steps of:

-   -   sensing an orientation of the scanner relative to the        position-coding pattern;    -   using the orientation together with said absolute positions to        assemble said scanned graphic image.

Optionally, said impression identity is accessed from any one of:

-   -   a memory in said scanner, said memory storing a plurality of        impression identities; and    -   a computer system communicating with said scanner.

Optionally, said images of the graphic image are captured using a secondimage sensor positioned parallel and/or substantially coextensive with aprinthead.

Optionally, the method further comprising the step of communicating theassociation data to a computer system, the computer system beingconfigured to confer interactivity on at least part of the pre-printedgraphic image using the association data.

Optionally, said association data enables said computer system toassociate one or more zones of the graphic image with a correspondinginteractive element.

Optionally, said interactive element is a hyperlink and said computersystem is configured to:

-   -   receive the association data from the scanner;    -   perform Optical Character Recognition (OCR) on the scanned        graphic image to convert text images into computer text;    -   identify a URI text string in the computer text;    -   generate an input description for said scanned graphic image,        said input description describing the URI and a zone of the URI        text string in the scanned graphic image; and    -   store a page description comprising said input description and        said scanned graphic image, said page description being indexed        with said impression identity.

Optionally, the method further comprising the steps of:

-   -   interacting with a pre-printed URI text string on the surface        using an optically imaging sensing device;    -   reading at least part of the position-coding pattern;    -   generating interaction data identifying the impression identity        and a position of the sensing device;    -   communicating the interaction data to the computer system; and    -   receiving a resource corresponding to the hyperlink.

Optionally, said computer system is configured to:

-   -   receive the association data from the scanner;    -   perform Optical Character Recognition (OCR) on the scanned        graphic image to convert text images into computer text;    -   generate an input description for said scanned graphic image,        said input description describing words of computer text and        zones of corresponding text images in the scanned graphic image;        and    -   store a page description comprising said input description and        said scanned graphic image, said page description being indexed        with said impression identity.

Optionally, the method further comprising the steps of:

-   -   interacting with a printed portion of text on the surface using        an optically imaging sensing device;    -   reading at least part of the position-coding pattern;    -   generating interaction data identifying the impression identity        and a position of the sensing device;    -   communicating the interaction data to the computer system; and        at least one of:    -   receiving search results relating to said portion of text; and    -   copying computer text corresponding to said portion of text to a        clipboard.

In an eighth aspect the present invention provides a method ofswipe-scanning a graphic image printed on a surface, said surface havinga position-coding pattern superimposed with the graphic image, saidmethod comprising the steps of:

-   -   (i) operatively positioning a swipe scanner relative to the        surface;    -   (ii) swiping the scanner across the surface;    -   (iii) capturing, during said swipe, successive images of        portions of the graphic image;    -   (iv) imaging, during said swipe, successive parts of the        position-coding pattern;    -   (v) determining absolute positions of the scanner using the        imaged parts of the position-coding pattern; and    -   (vi) using the absolute positions to assemble said captured        portions of said graphic image into a scanned graphic image.

Optionally, said positions of said scanner are sensed using a firstimage sensor.

Optionally, the method further comprising the step of:

-   -   sensing relative motion of the scanner using a motion sensor.

Optionally, the method further comprising the step of:

-   -   using said sensed relative motion together with said absolute        positions to assemble said scanned graphic image.

Optionally, said motion sensor is an optical mouse sensor.

Optionally, said optical mouse sensor utilizes said first image sensor.

Optionally, said images of the graphic image are captured using a secondimage sensor.

Optionally, the method where the second image sensor is a linear imagesensor.

Optionally, said second image sensor extends substantially a width ofsaid scanner.

Optionally, said position-coding pattern is printed with aninfrared-absorbing ink.

Optionally, the graphic image is printed with one or more inks having aninfrared window enabling imaging of said position-coding pattern in thepresence of said one or more inks.

Optionally, the method further comprising the steps of:

-   -   sensing an orientation of the scanner relative to the        position-coding pattern;    -   using the orientation together with said absolute positions to        assemble said scanned graphic image.

Optionally, the method further comprising the step of:

-   -   communicating the scanned graphic image to a computer system.

In a ninth aspect the present invention provides a method of conferringinteractivity on a pre-printed graphic image containing a URI textstring, said graphic image having been scanned and had a position-codingpattern printed thereon, said position-coding pattern identifying aplurality of absolute positions and an impression identity for thegraphic image, said method comprising the steps of:

-   -   (i) receiving, in a computer system, association data indicating        an association between the impression identity, the plurality of        absolute positions and a scanned graphic image;    -   (ii) performing Optical Character Recognition (OCR) on the        scanned graphic image to convert text images into computer text;    -   (iii) identifying a URI text string in the computer text;    -   (iv) generating an input description for said scanned graphic        image, said input description describing a URI corresponding to        said URI text string and a zone of the URI text string in the        scanned graphic image; and    -   (v) storing a page description comprising said input description        and said scanned graphic image, said page description being        indexed with said impression identity,        wherein said page description is retrievable so as to confer        interactivity on the graphic image.

Optionally, the zone of the URI text string is explicitly described withreference to coordinate positions.

Optionally, the zone of the URI text string is inferred from one or moreof: a length of the URI text string, a point size of the computer textcontaining the URI text string, and a position of the URI text string inthe computer text.

Optionally, the method further comprising the steps of:

-   -   (vi) receiving interaction data from an optically imaging        sensing device interacting with the URI text string contained in        the pre-printed graphic image, said interaction data identifying        the impression identity and a position of the sensing device;    -   (vii) retrieving the page description using the impression        identity; and    -   (viii) identifying the URI using the position of the sensing        device and the retrieved page description.

Optionally, the method further comprising the steps of:

-   -   retrieving a resource corresponding to the identified URI; and    -   sending the resource to a user's display device.

Optionally, the method further comprising the step of:

-   -   sending the URI to a user's web browser.

Optionally, said pre-printed graphic image is scanned using aswipe-scanner, said swipe-scanner comprising a printhead for printingsaid position-coding pattern during scanning of said pre-printed graphicimage.

In another aspect the present invention provides a method of conferringinteractivity on a pre-printed graphic image containing a URI textstring, said graphic image having been scanned and had a position-codingpattern printed thereon, said position-coding pattern identifying aplurality of absolute positions and an impression identity for thegraphic image, said method comprising the steps of:

-   -   (i) receiving, in a computer system, association data indicating        an association between the impression identity, the plurality of        absolute positions and a scanned graphic image;    -   (ii) receiving interaction data from an optically imaging        sensing device interacting with the URI text string contained in        the pre-printed graphic image, said interaction data identifying        the impression identity and a position of the sensing device;    -   (iii) performing Optical Character Recognition (OCR) on at least        a portion of the scanned graphic image to convert text images        into computer text;    -   (iv) identifying the URI text string in the computer text; and    -   (v) identifying the URI from the URI text string.

Optionally, the portion of the scanned graphic image is a word, sentenceor paragraph containing the position of the sensing device.

In a further aspect the present invention provides a method ofconferring interactivity on a pre-printed graphic image containing a URItext string, said graphic image having been scanned and had aposition-coding pattern printed thereon, said position-coding patternidentifying a plurality of absolute positions and an impression identityfor the graphic image, said method comprising the steps of:

-   -   (i) receiving, in a computer system, association data indicating        an association between the impression identity, the plurality of        absolute positions and a scanned graphic image;    -   (ii) performing Optical Character Recognition (OCR) on the        scanned graphic image to convert text images into computer text;    -   (iii) generating an input description for said scanned graphic        image, said input description describing words of computer text        and zones of corresponding text images in the scanned graphic        image;    -   (iv) storing a page description comprising said input        description and said scanned graphic image, said page        description being indexed with said impression identity,    -   (v) receiving interaction data from an optically imaging sensing        device interacting with the URI text string contained in the        pre-printed graphic image, said interaction data identifying the        impression identity and a position of the sensing device;    -   (vi) retrieving the page description using the impression        identity;    -   (iv) identifying the URI text string in the computer text; and    -   (v) identifying the URI from the URI text string.

I a further aspect the present invention provides a system forconferring interactivity on a pre-printed graphic image containing a URItext string, said graphic image having been scanned and had aposition-coding pattern printed thereon, said position-coding patternidentifying a plurality of absolute positions and an impression identityfor the graphic image, said system comprises a computer systemconfigured for:

-   -   (i) receiving association data indicating an association between        the impression identity, the plurality of absolute positions and        a scanned graphic image;    -   (ii) performing Optical Character Recognition (OCR) on the        scanned graphic image to convert text images into computer text;    -   (iii) identifying a URI text string in the computer text;    -   (iv) generating an input description for said scanned graphic        image, said input description describing a URI corresponding to        the URI text string and a zone of the URI text string in the        scanned graphic image; and    -   (v) storing a page description comprising said input description        and said scanned graphic image, said page description being        indexed with said impression identity,        wherein said page description is retrievable so as to confer        interactivity on the graphic image.

Optionally, the system further comprising a scanner for scanning thepre-printed graphic image.

Optionally, said scanner comprises a printhead for printing theposition-coding pattern.

Optionally, said scanner comprises a processor for generating theassociation data.

Optionally, the system further comprising an optically imaging sensingdevice configured for:

-   -   interacting with the pre-printed graphic image;    -   reading at least part of the position-coding pattern;    -   generating interaction data identifying the impression identity        and a position of the sensing device; and    -   communicating the interaction data to the computer system.

Optionally, said computer system is further configured for:

-   -   (vi) receiving interaction data from an optically imaging        sensing device interacting with the URI text string contained in        the pre-printed graphic image, said interaction data identifying        the impression identity and a position of the sensing device;    -   (vii) retrieving the page description using the impression        identity; and    -   (viii) identifying the URI using the position of the sensing        device and the retrieved page description.

Optionally, said computer system is further configured for:

-   -   retrieving a resource corresponding to the identified URI; and    -   sending the resource to a user's display device.

Optionally, said computer system is further configured for:

-   -   sending the URI to a web browser running on a user's display        device.

In another aspect the present invention provides a system for conferringinteractivity on a pre-printed graphic image containing a URI textstring, said graphic image having been scanned and had a position-codingpattern printed thereon, said position-coding pattern identifying aplurality of absolute positions and an impression identity for thegraphic image, said system comprises a computer system configured for:

-   -   (i) receiving association data indicating an association between        the impression identity, the plurality of absolute positions and        a scanned graphic image;    -   (ii) receiving interaction data from an optically imaging        sensing device interacting with the URI text string contained in        the pre-printed graphic image, said interaction data identifying        the impression identity and a position of the sensing device;    -   (iii) performing Optical Character Recognition (OCR) on at least        a portion of the scanned graphic image to convert text images        into computer text;    -   (iv) identifying a URI text string in the computer text; and    -   (v) identifying the URI from the URI text string.

Optionally, the portion of the scanned graphic image is a word, sentenceor paragraph containing the position of the sensing device.

In a tenth aspect the present invention provides a method of conferringinteractivity on a pre-printed graphic image containing text, saidgraphic image having been scanned and had a position-coding patternprinted thereon, said position-coding pattern identifying a plurality ofabsolute positions and an impression identity for the graphic image,said method comprising the steps of:

-   -   (i) receiving, in a computer system, association data indicating        an association between the impression identity, the plurality of        absolute positions and a scanned graphic image;    -   (ii) performing Optical Character Recognition (OCR) on the        scanned graphic image to convert text images into computer text;    -   (iii) generating an input description for said scanned graphic        image, said input description describing words of computer text        and zones of corresponding text images in the scanned graphic        image; and    -   (iv) storing a page description comprising said input        description and said scanned graphic image, said page        description being indexed with said impression identity,        wherein said page description is retrievable so as to confer        interactivity on the graphic image.

Optionally, the zone of the text image is explicitly described withreference to coordinate positions.

Optionally, the zones of text images are inferred, using the computertext, from one or more of: lengths of words, point size, and positionsof the words in the computer text.

Optionally, the method further comprising the steps of:

-   -   (v) receiving interaction data from an optically imaging sensing        device interacting with a portion of text contained in the        pre-printed graphic image, said interaction data identifying the        impression identity and a position of the sensing device; and    -   (vi) retrieving the page description using the impression        identity.

Optionally, the method further comprising the step of:

-   -   identifying a search query using said retrieved page description        and the position of the sensing device, said search query        including one or more keywords contained in said portion of        text;    -   generating a request URI using said search query; and    -   sending the request URI, or search results obtained using the        request URI, to a user.

Optionally, the method further comprising the step of:

-   -   identifying computer text corresponding to said portion of text        using the page description and the position of the sensing        device; and    -   copying the identified computer text to a clipboard.

Optionally, the method further comprising the step of:

-   -   pasting contents of the clipboard to an application.

In another aspect the present invention provides a method of conferringinteractivity on a pre-printed graphic image containing text, saidgraphic image having been scanned and had a position-coding patternprinted thereon, said position-coding pattern identifying a plurality ofabsolute positions and an impression identity for the graphic image,said method comprising the steps of:

-   -   (i) receiving, in a computer system, association data indicating        an association between the impression identity, the plurality of        absolute positions and a scanned graphic image;    -   (ii) receiving interaction data from an optically imaging        sensing device interacting with a portion of text contained in        the pre-printed graphic image, said interaction data identifying        the impression identity and a position of the sensing device;    -   (iii) performing Optical Character Recognition (OCR) on at least        a portion of the scanned graphic image to convert text images        into computer text; and    -   (iv) identifying one or more words of computer text contained in        the portion of the scanned graphic image.

Optionally, the portion of the scanned graphic image is a word, sentenceor paragraph containing the position of the sensing device.

Optionally, said one or more words of computer text are used to initiateat least one of: a search, copying to a clipboard, and pasting to anapplication.

In a further aspect the present invention provides a system forconferring interactivity on a pre-printed graphic image containing text,said graphic image having been scanned and had a position-coding patternprinted thereon, said position-coding pattern identifying a plurality ofabsolute positions and an impression identity for the graphic image,said system comprising a computer system configured for:

-   -   (i) receiving association data indicating an association between        the impression identity, the plurality of absolute positions and        a scanned graphic image;    -   (ii) performing Optical Character Recognition (OCR) on the        scanned graphic image to convert text images into computer text;    -   (iii) generating an input description for said scanned graphic        image, said input description describing words of computer text        and zones of corresponding text images in the scanned graphic        image; and    -   (iv) storing a page description comprising said input        description and said scanned graphic image, said page        description being indexed with said impression identity,        wherein said page description is retrievable so as to confer        interactivity on the graphic image.

Optionally, the system further comprising a scanner for scanning thepre-printed graphic image.

Optionally, said scanner comprises a printhead for printing theposition-coding pattern and a processor for generating the associationdata.

Optionally, the system further comprising an optically imaging sensingdevice configured for:

-   -   interacting with the pre-printed graphic image;    -   reading at least part of the position-coding pattern;    -   generating interaction data identifying the impression identity        and a position of the sensing device; and    -   communicating the interaction data to the computer system.

Optionally, said computer system is further configured for:

-   -   (v) receiving interaction data from an optically imaging sensing        device interacting with a portion of text contained in the        pre-printed graphic image, said interaction data identifying the        impression identity and a position of the sensing device; and    -   (vi) retrieving the page description using the impression        identity.

Optionally, said computer system is further configured for:

-   -   identifying a search query using said retrieved page description        and the position of the sensing device, said search query        including one or more keywords contained in said portion of        text;    -   generating a request URI using said search query; and    -   sending the request URI, or search results obtained using the        request URI, to a user.

Optionally, said computer system is further configured for:

-   -   identifying computer text corresponding to said portion of text        using the page description and the position of the sensing        device; and    -   copying the identified computer text to a clipboard.

In a further aspect the present invention provides a system forconferring interactivity on a pre-printed graphic image containing text,said graphic image having been scanned and had a position-coding patternprinted thereon, said position-coding pattern identifying a plurality ofabsolute positions and an impression identity for the graphic image,said system comprising a computer system configured for:

-   -   (i) receiving association data indicating an association between        the impression identity, the plurality of absolute positions and        a scanned graphic image;    -   (ii) receiving interaction data from an optically imaging        sensing device interacting with a portion of text contained in        the pre-printed graphic image, said interaction data identifying        the impression identity and a position of the sensing device;    -   (iii) performing Optical Character Recognition (OCR) on at least        a portion of the scanned graphic image to convert text images        into computer text; and    -   (iv) identifying one or more words of computer text contained in        the portion of the scanned graphic image.

Optionally, the portion of the scanned graphic image is a word, sentenceor paragraph containing the position of the sensing device.

Optionally, said computer system is configured to use said one or morewords of computer text to initiate at least one of: a search, copying toa clipboard, and pasting to an application.

In an eleventh aspect the present invention provides a flatbed scannercomprising:

-   -   a platen for supporting a substrate, said substrate having a        surface bearing a pre-printed graphic image;    -   a carriage for traversing across the surface, said carriage        comprising:        -   a pagewidth scanhead for scanning the pre-printed graphic            image during a traverse of the surface; and        -   a pagewidth printhead for printing a position-coding pattern            onto said surface during said traverse, said position-coding            pattern identifying an impression identity and a plurality            of positions;    -   an ink supply containing an ink for printing the position-coding        pattern; and    -   a processor configured for generating association data, said        association data indicating an association between a scanned        graphic image, the impression identity and the plurality of        positions.

Optionally, said ink is an infrared-absorbing ink.

Optionally, the flatbed further comprising a memory for storing aplurality of impression identities, each stored impression identitybeing associable with the scanned graphic image.

Optionally, said ink supply comprises said memory.

Optionally, the flatbed scanner further comprising communication meansfor communicating with a computer system.

Optionally, said association data enables said computer system toassociate one or more zones of the scanned graphic image with acorresponding interactive element.

Optionally, said interactive element is selected from the groupcomprising: a hyperlink, an input field and a button.

Optionally, said computer system is configured for:

-   -   (i) performing Optical Character Recognition (OCR) on the        scanned graphic image to convert text images into computer text;    -   (ii) generating an input description for said scanned graphic        image, said input description describing words of computer text        and zones of corresponding text images in the scanned graphic        image; and    -   (iii) storing a page description comprising said input        description and said scanned graphic image, said page        description being indexed with said impression identity,        wherein said page description is retrievable so as to confer        interactivity on the graphic image.

Optionally, said computer system is further configured for:

-   -   identifying a URI text string in the computer text; and    -   generating the input description further describing a URI        corresponding to said URI text string and a zone of the        corresponding URI text string in the scanned graphic image.

Optionally, said carriage further comprises an image sensor positionedand configured for imaging portions of the position-coding patternprinted on said surface during said traverse.

Optionally, said image sensor is positioned downstream of saidprinthead, wherein a direction of said traverse is defined as upstream.

Optionally, is configurable in at least one mode selected from:

-   -   a conventional scanning mode in which said scanhead scans and        said printhead does not print the position-coding pattern; and    -   an interactive scanning mode in which said scanhead scans and        said printhead prints the position-coding pattern.

In another aspect the present invention provides a system for conferringinteractivity on a pre-printed graphic image, said system comprising:

(A) a flatbed scanner comprising:

-   -   a platen for supporting a substrate, said substrate having a        surface bearing a pre-printed graphic image;    -   a carriage for traversing across the surface, said carriage        comprising:        -   a pagewidth scanhead for scanning the pre-printed graphic            image during a traverse of the surface; and        -   a pagewidth printhead for printing a position-coding pattern            onto said surface during said traverse, said position-coding            pattern identifying an impression identity and a plurality            of positions;    -   an ink supply containing an ink for printing the position-coding        pattern;    -   a processor configured for generating association data        indicating an association between a scanned graphic image, the        impression identity and the plurality of positions; and    -   communication means for communication the association data to a        computer system; and        (B) the computer system configured for:    -   receiving the association data; and    -   storing a page description for said scanned graphic image, said        page description being indexed with said impression identity        wherein said page description is retrievable so as to confer        interactivity on the graphic image.

Optionally, said computer system is configured for:

-   -   (i) performing Optical Character Recognition (OCR) on the        scanned graphic image to convert text images into computer text;    -   (ii) generating an input description for said scanned graphic        image, said input description describing words of computer text        and zones of corresponding text images in the scanned graphic        image; and    -   (iii) storing the page description comprising said input        description and said scanned graphic image, said page        description being indexed with said impression identity,        wherein said page description is retrievable so as to confer        interactivity on the graphic image.

Optionally, said computer system is further configured for:

-   -   identifying a URI text string in the computer text; and    -   generating the input description further describing a URI        corresponding to said URI text string and a zone of the        corresponding URI text string in the scanned graphic image.

In a twelfth aspect the present invention provides a printer comprising:

-   -   a feed mechanism for feeding a substrate past a printhead        assembly, said substrate having a surface bearing a pre-printed        graphic image;    -   a printhead assembly comprising:        -   a printhead for printing a position-coding pattern onto said            surface, said position-coding pattern identifying an            impression identity and a plurality of positions; and        -   a scanhead for scanning the pre-printed graphic image;    -   an ink supply containing an ink for printing the position-coding        pattern; and    -   a processor configured for generating association data, said        association data indicating an association between a scanned        graphic image, the impression identity and the plurality of        positions.

Optionally, said printhead is a stationary pagewidth printhead.

Optionally, said scanhead is a stationary pagewidth scanhead.

Optionally, said ink is an infrared-absorbing ink.

Optionally, the printer further comprising a memory for storing aplurality of impression identities, each stored impression identitybeing associable with a scanned graphic image.

Optionally, said ink supply comprises said memory.

Optionally, the printer further comprising communication means forcommunicating with a computer system.

Optionally, said association data enables said computer system toassociate one or more zones of the scanned graphic image with acorresponding interactive element.

Optionally, said interactive element is selected from the groupcomprising: a hyperlink, an input field and a button.

Optionally, said computer system is configured for:

-   -   (i) performing Optical Character Recognition (OCR) on the        scanned graphic image to convert text images into computer text;    -   (ii) generating an input description for said scanned graphic        image, said input description describing words of computer text        and zones of corresponding text images in the scanned graphic        image; and    -   (iii) storing a page description comprising said input        description and said scanned graphic image, said page        description being indexed with said impression identity,        wherein said page description is retrievable so as to confer        interactivity on the graphic image.

Optionally, said computer system is further configured for:

-   -   identifying a URI text string in the computer text; and    -   generating the input description further describing a URI        corresponding to said URI text string and a zone of the        corresponding URI text string in the scanned graphic image.

Optionally, said printhead assembly further comprises an image sensorpositioned and configured for imaging portions of the position-codingpattern printed on said surface.

Optionally, said image sensor is positioned downstream of saidprinthead, wherein a direction of feeding said substrate is defined asdownstream.

Optionally, the printhead is configured for printing colored graphicimages in addition to said position-coding pattern, and wherein said inksupply comprises colored inks.

Optionally, is configurable in at least one mode selected from:

-   -   a conventional scanning mode in which said scanhead scans and        said printhead does not print;    -   an interactive scanning mode in which said scanhead scans, said        printhead prints the position-coding pattern and said processor        generates the association data;    -   a conventional printing mode in which said printhead prints        colored graphic images and said scanhead does not scan; and    -   an interactive printing mode in which said printhead prints        colored graphic images together with the position-coding pattern        and said scanhead does not scan.

In another aspect the present invention provides a system for conferringinteractivity on a pre-printed graphic image, said system comprising:

(A) a printer comprising:

-   -   a feed mechanism for feeding a substrate past a printhead        assembly, said substrate having a surface bearing a pre-printed        graphic image;    -   a printhead assembly comprising:        -   a printhead for printing a position-coding pattern onto said            surface, said position-coding pattern identifying an            impression identity and a plurality of positions;        -   a scanhead for scanning the pre-printed graphic image;    -   an ink supply containing an ink for printing the position-coding        pattern;    -   a processor configured for generating association data, said        association data indicating an association between a scanned        graphic image, the impression identity and the plurality of        positions; and    -   communication means for communication the association data to a        computer system; and        (B) the computer system configured for:    -   receiving the association data; and    -   storing a page description for said scanned graphic image, said        page description being indexed with said impression identity        wherein said page description is retrievable so as to confer        interactivity on the graphic image.

Optionally, said computer system is configured for:

-   -   (i) performing Optical Character Recognition (OCR) on the        scanned graphic image to convert text images into computer text;    -   (ii) generating an input description for said scanned graphic        image, said input description describing words of computer text        and zones of corresponding text images in the scanned graphic        image; and    -   (iii) storing the page description comprising said input        description and said scanned graphic image, said page        description being indexed with said impression identity,        wherein said page description is retrievable so as to confer        interactivity on the graphic image.

Optionally, said computer system is further configured for:

-   -   identifying a URI text string in the computer text; and    -   generating the input description further describing a URI        corresponding to said URI text string and a zone of the        corresponding URI text string in the scanned graphic image.

In a thirteenth aspect the present invention provides a method ofconferring interactivity on a pre-printed graphic image, said methodcomprising the steps of:

-   -   (i) providing a substrate having a surface bearing the        pre-printed graphic image and an imposed position-coding        pattern, said position-coding pattern identifying an impression        identity and a plurality of absolute positions;    -   (ii) scanning said surface with a scanhead, said scanning        capturing successive images of portions of the graphic image;    -   (iii) imaging, during said scan, at least one part of the        position-coding pattern using an optical sensor;    -   (iv) determining at least one absolute position using the imaged        part of the position-coding pattern;    -   (v) determining the impression identity using the imaged part of        the position-coding pattern;    -   (vi) assembling said captured portions of said graphic image        into a scanned graphic image;    -   (vii) generating association data indicating an association        between the scanned graphic image, the impression identity and a        plurality of absolute positions; and    -   (viii) communicating the association data to a computer system,        thereby enabling the computer system to confer interactivity on        the graphic image.

Optionally, said position-coding pattern is printed on said surfacesubsequently to said pre-printed graphic image.

Optionally, said position-coding pattern is disposed on an adhesivetransparency attached to said surface.

Optionally, said scanned image is assembled using at least one of:absolute positions of the scanhead determined from: a plurality ofimaged parts of the position-coding pattern and a known distance betweenthe scanhead and the optical sensor;

-   -   a known speed of the scanhead relative to the surface;    -   a known speed of the surface relative to the scanhead.

Optionally, said scanhead is a moving scanhead and said surface isstationary.

Optionally, said scanhead is stationary and said substrate is fed pastthe scanhead.

Optionally, said association data enables said computer system toassociate one or more zones of the scanned graphic image with acorresponding interactive element.

Optionally, said interactive element is selected from the groupcomprising: a hyperlink, an input field and a button.

Optionally, the method further comprising the steps of:

-   -   performing Optical Character Recognition (OCR) on the scanned        graphic image to convert text images into computer text;    -   generating an input description for said scanned graphic image,        said input description describing words of computer text and        zones of corresponding text images in the scanned graphic image;        and    -   storing a page description comprising said input description and        said scanned graphic image, said page description being indexed        with said impression identity,        wherein said page description is retrievable so as to confer        interactivity on the graphic image.

Optionally, the method further comprising the steps of:

-   -   identifying a URI text string in the computer text; and    -   generating the input description further describing a URI        corresponding to the URI text string and a zone of the        corresponding URI text string in the scanned graphic image.

Optionally, in step (i), said impression identity is unassociated withsaid graphic image.

In a further aspect the present invention provides a method ofconferring interactivity on a pre-printed graphic image, said methodcomprising the steps of:

-   -   (i) imposing a position-coding pattern onto a surface bearing        the pre-printed graphic image, said position-coding pattern        identifying an impression identity and a plurality of absolute        positions;    -   (ii) scanning said surface with a scanhead, said scanning        capturing successive images of portions of the graphic image;    -   (iii) imaging, during said scan, at least one part of the        position-coding pattern using an optical sensor;    -   (iv) determining at least one absolute position using the imaged        part of the position-coding pattern;    -   (v) determining the impression identity using the imaged part of        the position-coding pattern;    -   (vi) assembling said captured portions of said graphic image        into a scanned graphic image;    -   (vii) generating association data indicating an association        between the scanned graphic image, the impression identity and        the plurality of absolute positions; and    -   (viii) communicating the association data to a computer system,        thereby enabling the computer system to confer interactivity on        the graphic image.

Optionally, said position-coding pattern is imposed by means of printingthe pattern onto the surface.

Optionally, said position-coding pattern is imposed by means ofattaching an adhesive transparency to the surface, said transparencycomprising the position-coding pattern.

In a further aspect the present invention provides a system forconferring interactivity on a pre-printed graphic image, said systemcomprising:

(A) a substrate having a surface bearing the pre-printed graphic imageand an imposed position-coding pattern, said position-coding patternidentifying an impression identity and a plurality of absolutepositions;(B) a scanner comprising:

-   -   (a) a scanhead for capturing successive images of portions of        the graphic image;    -   (b) an optical sensor for imaging, during said scan, at least        one part of the position-coding pattern;    -   (c) a processor configured for:        -   determining at least one absolute position using the imaged            part of the position-coding pattern;        -   determining the impression identity using the imaged part of            the position-coding pattern;        -   assembling said captured portions of said graphic image into            a scanned graphic image; and        -   generating association data indicating an association            between the scanned graphic image, the impression identity            and the plurality of absolute positions; and    -   (d) communication means for communicating the association data        to a computer system, thereby enabling the computer system to        confer interactivity on the graphic image.

Optionally, the system further comprising:

(C) the computer system configured for:

-   -   receiving the association data; and    -   storing a page description for said scanned graphic image, said        page description being indexed with said impression identity,        wherein said page description is retrievable so as to confer        interactivity on the graphic image.

Optionally, said computer system is configured for:

-   -   (i) performing Optical Character Recognition (OCR) on the        scanned graphic image to convert text images into computer text;    -   (ii) generating an input description for said scanned graphic        image, said input description describing words of computer text        and zones of corresponding text images in the scanned graphic        image; and    -   (iii) storing the page description comprising said input        description and said scanned graphic image, said page        description being indexed with said impression identity,        wherein said page description is retrievable so as to confer        interactivity on the graphic image.

Optionally, said computer system is further configured for:

-   -   identifying a URI text string in the computer text; and    -   generating the input description further describing a URI        corresponding to said URI text string and a zone of the        corresponding URI text string in the scanned graphic image.

Optionally, said impression identity is initially unassociated with thegraphic image in the substrate (A).

BRIEF DESCRIPTION OF DRAWINGS

Preferred and other embodiments of the invention will now be described,by way of non-limiting example only, with reference to the accompanyingdrawings, in which:

FIG. 1 is a schematic of a the relationship between a sample printednetpage and its online page description;

FIG. 2 shows an embodiment of basic netpage architecture with variousalternatives for the relay device;

FIG. 3 shows a schematic block diagram of a Netpage swipe printeraccording to the present invention;

FIG. 4 shows an image to be printed;

FIG. 5 shows the effect of a first swipe using the Netpage swipeprinter;

FIG. 6 shows the effect of a second swipe;

FIG. 7 shows schematically a Netpage printer including a pagewidthscanhead;

FIG. 8 shows schematically a flatbed scanhead incorporating a printhead;

FIG. 9 shows schematically a flatbed scanhead with an optical tagsensor; and

FIG. 10 shows a transparency having a position-coding pattern.

DETAILED DESCRIPTION OF PREFERRED AND OTHER EMBODIMENTS 1 Netpage SystemOverview 1.1 Netpage System Architecture

The present invention is used in connection with the Applicant's netpagesystem, which has been described in detail in the cross-referencedpatent applications identified above.

In brief summary, the preferred form of the netpage system employs acomputer interface in the form of a mapped surface, that is, a physicalsurface which contains references to a map of the surface maintained ina computer system. The map references can be queried by an appropriatesensing device. Depending upon the specific implementation, the mapreferences may be encoded visibly or invisibly, and defined in such away that a local query on the mapped surface yields an unambiguous mapreference both within the map and among different maps. The computersystem can contain information about features on the mapped surface, andsuch information can be retrieved based on map references supplied by asensing device used with the mapped surface. The information thusretrieved can take the form of actions which are initiated by thecomputer system on behalf of the operator in response to the operator'sinteraction with the surface features.

In its preferred form, the netpage system relies on the production of,and human interaction with, netpages. These are pages of text, graphicsand images printed on ordinary paper, but which work like interactivewebpages. Information is encoded on each page using ink which issubstantially invisible to the unaided human eye. The ink, however, andthereby the coded data, can be sensed by an optically imaging sensingdevice (“reader”) and transmitted to the netpage system. The sensingdevice may take the form of, for example, a clicker (for clicking on aspecific position on a surface), a pointer having a stylus (for pointingor gesturing on a surface using pointer strokes), or a pen having amarking nib (for marking a surface with ink when pointing, gesturing orwriting on the surface). Any references herein to “pen” or “netpage pen”are provided by way of example only. It will, of course, be appreciatedthat the netpage pen may take the form of any suitable optically imagingsensing device or reader.

In one embodiment, active buttons and hyperlinks on each page can beclicked with the sensing device to request information from the networkor to signal preferences to a network server. In one embodiment, textwritten by hand on a netpage is automatically recognized and convertedto computer text in the netpage system, allowing forms to be filled in.In other embodiments, signatures recorded on a netpage are automaticallyverified, allowing e-commerce transactions to be securely authorized. Inother embodiments, text on a netpage may be clicked or gestured toinitiate a search based on keywords indicated by the user.

As illustrated in FIG. 1, a printed netpage 1 can represent aninteractive form which can be filled in by the user both physically, onthe printed page, and “electronically”, via communication between thepen and the netpage system. The example shows a “Request” formcontaining name and address fields and a submit button. The netpage 1consists of a graphic impression 2, printed using visible ink, and asurface coding pattern 3 superimposed with the graphic impression. Thecoding pattern 3 is typically printed with an infrared ink and thesuperimposed graphic impression 2 is printed with colored ink(s) havinga complementary infrared window, allowing infrared imaging of the codingpattern 3.

The surface coding pattern 3 typically takes the form of a grid oftarget dots, which comprises a collection of tags 4. One such tag 4 isshown in the shaded region of FIG. 1, although it will be appreciatedthat contiguous tags 4, defined by the coding pattern 3, are denselytiled over the whole netpage 1.

A corresponding page description 5, stored on the netpage network,describes the individual elements of the netpage. In particular it hasan input description describing the type and spatial extent (zone) ofeach interactive element (i.e. text field or button in the example), toallow the netpage system to correctly interpret input via the netpage.The submit button 6, for example, has a zone 7 which corresponds to thespatial extent of the corresponding graphic 8.

As illustrated in FIG. 2, a netpage reader 400 (e.g. netpage pen) worksin conjunction with a netpage relay device 601, which is anInternet-connected device for home, office or mobile use. The reader 400is wireless and communicates securely with the netpage relay device 601via a short-range radio link 9. In an alternative embodiment, the reader400 utilizes a wired connection, such as a USB or other serialconnection, to the relay device 601.

The relay device 601 performs the basic function of relaying interactiondata to a page server 10, which interprets the interaction data. Asshown in FIG. 2, the relay device 601 may, for example, take the form ofa personal computer 601 a, a netpage printer 601 b or some other relay601 c (e.g. personal computer or mobile phone incorporating a webbrowser).

The netpage printer 601 b is able to deliver, periodically or on demand,personalized newspapers, magazines, catalogs, brochures and otherpublications, all printed at high quality as interactive netpages.Unlike a personal computer, the netpage printer is an appliance whichcan be, for example, wall-mounted adjacent to an area where the morningnews is first consumed, such as in a user's kitchen, near a breakfasttable, or near the household's point of departure for the day. It alsocomes in tabletop, desktop, portable and miniature versions. Netpagesprinted on-demand at their point of consumption combine the ease-of-useof paper with the timeliness and interactivity of an interactive medium.

Alternatively, the netpage relay device 601 may be a portable device,such as a mobile phone or PDA, a laptop or desktop computer, or aninformation appliance connected to a shared display, such as a TV. Ifthe relay device 601 is not a netpage printer 601 b which printsnetpages digitally and on demand, the netpages may be printed bytraditional analog printing presses, using such techniques as offsetlithography, flexography, screen printing, relief printing androtogravure, as well as by digital printing presses, using techniquessuch as drop-on-demand inkjet, continuous inkjet, dye transfer, andlaser printing. As will be explained in more detail below, the presentinvention provides an alternative means which enables users convenientlyto generate netpages, as well as scan or print images.

As shown in FIG. 2, the netpage reader 400 interacts with a portion ofthe position-coding tag pattern on a printed netpage 1, or other printedsubstrate such as a label of a product item 251, and communicates, via ashort-range radio link 9, the interaction to the relay device 601. Therelay 601 sends corresponding interaction data to the relevant netpagepage server 10 for interpretation. Raw data received from the netpagereader 400 may be relayed directly to the page server 10 as interactiondata. Alternatively, the interaction data may be encoded in the form ofan interaction URI and transmitted to the page server 10 via a user'sweb browser 601 c. The web browser 601 c may then receive a URI from thepage server 10 and access a webpage via a webserver 201. In somecircumstances, the page server 10 may access application computersoftware running on a netpage application server 13.

The netpage relay device 601 can be configured to support any number ofreaders 400, and a reader can work with any number of netpage relays. Inthe preferred implementation, each netpage reader 400 has a uniqueidentifier. This allows each user to maintain a distinct profile withrespect to a netpage page server 10 or application server 13.

A netpage pen may be registered with a netpage registration server 11and linked to one or more payment card accounts. This allows e-commercepayments to be securely authorized using the netpage pen. The netpageregistration server compares the signature captured by the netpage penwith a previously registered signature, allowing it to authenticate theuser's identity to an e-commerce server. Other biometrics can also beused to verify identity. One version of the netpage pen includesfingerprint scanning, verified in a similar way by the netpageregistration server.

1.2 Netpages

Netpages are the foundation on which a netpage network is built. Theyprovide a paper-based user interface to published information andinteractive services.

As shown in FIG. 1, a netpage consists of a printed page (or othersurface region) invisibly tagged with references to an onlinedescription 5 of the page. The online page description 5 is maintainedpersistently by the netpage page server 10. The page description has avisual description describing the visible layout and content of thepage, including text, graphics and images. It also has an inputdescription describing the input elements on the page, includingbuttons, hyperlinks, and input fields. A netpage allows markings madewith a netpage pen on its surface to be simultaneously captured andprocessed by the netpage system.

Multiple netpages (for example, those printed by analog printingpresses) can share the same page description. However, to allow inputthrough otherwise identical pages to be distinguished, each netpage maybe assigned a unique page identifier in the form of a page ID (or, moregenerally, an impression ID). The page ID has sufficient precision todistinguish between a very large number of netpages.

Each reference to the page description 5 is repeatedly encoded in thenetpage pattern. Each tag (and/or a collection of contiguous tags)identifies the unique page on which it appears, and thereby indirectlyidentifies the page description 5. Each tag also identifies its ownposition on the page. Characteristics of the tags are described in moredetail below.

Tags are typically printed in infrared-absorptive ink on any substratewhich is infrared-reflective, such as ordinary paper, or in infraredfluorescing ink. Near-infrared wavelengths are invisible to the humaneye but are easily sensed by a solid-state image sensor with anappropriate filter.

A tag is sensed by a 2D area image sensor in the netpage reader 400, andthe tag data is transmitted to the netpage system via the nearestnetpage relay device 601. The reader 400 is wireless and communicateswith the netpage relay device 601 via a short-range radio link. It isimportant that the reader recognize the page ID and position on everyinteraction with the page, since the interaction is stateless. Tags areerror-correctably encoded to make them partially tolerant to surfacedamage.

The netpage page server 10 maintains a unique page instance for eachunique printed netpage, allowing it to maintain a distinct set ofuser-supplied values for input fields in the page description 5 for eachprinted netpage 1.

1.3 Netpage Tags

Each tag 4, contained in the position-coding pattern 3, identifies anabsolute location of that tag within a region of a substrate.

Each interaction with a netpage should also provide a region identitytogether with the tag location. In a preferred embodiment, the region towhich a tag refers coincides with an entire page, and the region ID istherefore synonymous with the page ID of the page on which the tagappears. In other embodiments, the region to which a tag refers can bean arbitrary subregion of a page or other surface. For example, it cancoincide with the zone of an interactive element, in which case theregion ID can directly identify the interactive element.

As described in some of the Applicant's previous applications (e.g. U.S.Pat. No. 6,832,717), the region identity may be encoded discretely ineach tag 4. As described other of the Applicant's applications (e.g.U.S. application Ser. Nos. 12/025,746 & 12/025,765 filed on Feb. 5,2008), the region identity may be encoded by a plurality of contiguoustags in such a way that every interaction with the substrate stillidentifies the region identity, even if a whole tag is not in the fieldof view of the sensing device.

Each tag 4 should preferably identify an orientation of the tag relativeto the substrate on which the tag is printed. Strictly speaking, eachtag 4 identifies an orientation of tag data relative to a gridcontaining the tag data. However, since the grid is typically orientedin alignment with the substrate, then orientation data read from a tagenables the rotation (yaw) of the netpage reader 400 relative to thegrid, and thereby the substrate, to be determined. As explained inSection 3, the netpage reader 400 in the present invention typicallytakes the form of a swipe printer or swipe scanner.

A tag 4 may also encode one or more flags which relate to the region asa whole or to an individual tag. One or more flag bits may, for example,signal a netpage reader 400 to provide feedback indicative of a functionassociated with the immediate area of the tag, without the reader havingto refer to a corresponding page description 5 for the region. A netpagereader may, for example, illuminate an “active area” LED when positionedin the zone of a hyperlink.

A tag 4 may also encode a digital signature or a fragment thereof. Tagsencoding digital signatures (or a part thereof) are useful inapplications where it is required to verify a product's authenticity.Such applications are described in, for example, US Publication No.2007/0108285, the contents of which is herein incorporated by reference.The digital signature may be encoded in such a way that it can beretrieved from every interaction with the substrate. Alternatively, thedigital signature may be encoded in such a way that it can be assembledfrom a random or partial scan of the substrate.

It will, of course, be appreciated that other types of information (e.g.tag size etc) may also be encoded into each tag or a plurality of tags.

For a full description of netpage tags 4, reference is made to theApplicant's previously filed patent applications identified above, thecontents of which are herein incorporated by reference.

2. Swipe Printer

A printer built into a hand-held device such as a mobile phone or PDAcan be designed to transfer an image onto a surface as the device isswiped manually across the surface (see, for example, U.S. Pat. Nos.7,140,792 and 7,241,005, the contents of which are herein incorporatedby reference).

Swipe printers typically incorporate a wide printhead capable ofprinting an image several inches wide (e.g. from 1 to 4 inches) withoutthe printhead having to be scanned in the direction perpendicular to theswipe movement.

Typically, swipe printers known in the prior art incorporate one or moremotion sensors to allow it to print the image onto a surface withreasonable registration. Such sensors may consist of wheels that engagewith the surface and turn during movement, or non-contact sensors suchas optical mouse style sensors (see, for example, U.S. Pat. No.7,241,005).

A major drawback of existing swipe printers is that the motion sensorstypically only sense relative motion. This typically precludes the useof multiple swipes to print an image, e.g. an image wider than theprinthead. And although multiple motion sensors can be used to improvemotion sensing, such as more accurately sensing curved motion, manualswiping typically introduces some deformation into the printed image.

It would be desirable to provide an absolute reference on the surface,to allow both precise registration within a swipe, and preciseregistration between swipes. The Netpage system provides such areference, in the form of an infrared position-coding tag pattern 3 onthe surface (see, for example, U.S. Pat. No. 6,832,717 and U.S.application Ser. Nos. 12/025,746 & 12/025,765 filed on Feb. 5, 2008, thecontents of which are herein incorporated by reference).

The Netpage tag pattern 3 can already exist on the surface, e.g. if ithas been previously printed by a Netpage-enabled printer. Alternatively,the swipe printer can print the tag pattern as it proceeds. This latterarrangement has the added advantage that the printed image can beprinted onto plain paper and still be interactive in the full Netpagesense, i.e. supporting annotations, fillable form fields, andhyperlinks.

Referring to FIGS. 3 to 6, a Netpage swipe printer 100 incorporates aprinthead 110 and at least one Netpage tag sensor 120. The tag sensor120 is configured so that it can sense tags on a surface when the swipeprinter is placed on the surface ready for printing.

The tag sensor 120 senses its absolute location relative to a grid 3encoded in the tag pattern, as well as its orientation relative to thegrid. It also senses the unique identity of the surface, which is alsoencoded in the tag pattern 3. The tag sensor 120 senses its location andorientation on a regular and frequent basis, e.g. at a rate of 100 Hz ormore, and so functions as an absolute motion sensor. This potentiallyobviates the need for a relative motion sensor, or the need for morethan one motion sensor. However, relative motion sensors may still beused in combination with the tag sensor 120 to improve the accuracy ofposition sensing, or to lower the sampling rate of the tag sensor.

FIG. 3 shows a schematic block diagram of a Netpage swipe printer 100incorporated in a hand-held device 150 such as a mobile phone or PDA.

The swipe printer itself consists of the printhead 110, a printengine/controller 130 that generates dot data for the printhead andcontrols its operation, an ink cartridge 140, and the Netpage tag sensor120. The printhead 110 may be capable of printing one or several inks,such as a single ink (e.g. black), process colour via three or four inks(e.g. CMY or CMYK), and the Netpage tag pattern via an infrared ink.

The printhead may be a thermal or electromechanical printhead such as aMemjet printhead, as described previously by the present Applicant.

The ink cartridge 140 may incorporate memory containing a range ofimpression IDs for the swipe printer to use when printing Netpage tagpatterns 3. The memory may be incorporated in a QA chip.

The Netpage tag sensor 120 may utilise the same design as the tag sensorin the Netpage pen, described in the Applicant's previously patents andpatent applications (see, for example, U.S. Pat. No. 7,105,753; U.S.Pat. No. 7,015,901; U.S. Pat. No. 7,091,960; and US Publication No.2006/0028459, the contents of which are herein incorporated byreference). This may be adapted for the form factor of a hand-helddevice such as a mobile phone or PDA, as described in US Publication No.2005/0200638, the contents of which is herein incorporated by reference.It may also utilize a Netpage 2D contact image sensor (as described inApplicant's simultaneously co-filed applications identified by DocketNos. NPS149US and NPS150US) in order to achieve a slimmer deviceprofile.

The hand-held device 150 typically incorporates a microprocessor 151,program and data memory 152, a user interface 153 (e.g. touchscreen andbuttons), a communications module 154 (e.g. a wireless interface such asWi-Fi, Bluetooth, etc.), and a rechargeable battery 155.

The swipe printer 100 is usually intended for manual swiping of a page.However, robotically operated swipe printers (and swipe scanners asdescribed below) are also within the ambit of the present invention.Accordingly, the terms “swipe printer” and “swipe scanner” includerobotically-swipable printers and scanners (i.e. printers and scannerswhich are moved across a surface by a robot), as well as the more usualmanually-swipable printers and scanners. For a more detailed descriptionof robotically operated printers, reference is made to the Applicant'sU.S. Pat. No. 7,358,697, the contents of which is herein incorporated byreference.

2.1 Swipe Printing onto Tagged Surface

If the surface already carries a Netpage tag pattern 3, then printingproceeds as follows:

The user typically initiates the printing of an image onto the surfacevia the user interface 153 of the device 150 that incorporates the swipeprinter 100. The user interface 153 may consist of a graphical userinterface shown on a display, with soft buttons or options activated viaa stylus, finger or soft key. The user interface may also incorporate adedicated hardware button for initiating printing.

The term ‘image’ or ‘graphic image’ is intended to cover any graphicalcontent that may be printed, including text, photographs, line art, etc.

On the first swipe following initiation of printing, the swipe printer100 determines the starting point of the swipe via the tag sensor 120,records this as the starting point for the image, and prints anappropriate portion of the image as the swipe proceeds. The swipeprinter 100 can determine the extent of the page, either from the tagpattern itself or from a page description 5 associated with the pageidentifier encoded in the tag pattern 3, and can thus make an informeddecision about the suitable placement of the image on the page. Forexample, it can decide to place the image so that it doesn't straddle anedge of the page. It can also orient the image so that it is placedparallel to the grid and hence the page, with the correct orientationrelative to the page.

On subsequent swipes the swipe printer 100 prints additional portions ofthe image until the entire image has been transferred to the surface.Using the grid encoded in the tag pattern 3, the swipe printer is ableto print the image in perfect registration with the grid no matter howthe swipe is performed, and with perfect registration between successiveswipes.

By recording exactly which portions of the image it has already printed,the swipe printer 100 is able to avoid printing any portion twice. It isalso able to determine exactly when the image has been completelytransferred to the surface.

On the final swipe the swipe printer 100 records the image as fullytransferred, and exits printing mode.

Since the tag pattern 3 uniquely identifies the surface, the swipeprinter 100 can record the status of each incomplete image transfer forfuture reference. It can either record the status locally, i.e. in theswipe printer or the hosting device, or it can record it on a server.The status records the image content, a map of portions that havealready been transferred, the location of the image on the surface, andthe identity of the surface.

When the swipe printer 100 encounters a surface location with anassociated incomplete image transfer it is able to continue the imagetransfer even after an arbitrarily long intervening delay, and even ifit has performed other image transfers since the image transfer inquestion was initiated.

FIG. 4 shows an image 105 to be printed. FIG. 5 shows the effect of afirst swipe. FIG. 6 shows the effect of a second swipe, after which theimage has not quite been completely transferred.

Once printed, the image is associated with the surface in the fullNetpage sense. The image can become part of the visual description ofthe page, and any interactivity associated with the image, such ashyperlinks, can become part of the input description of the page via thecorresponding page description 5.

2.2 Swipe Printing onto Untagged Surface

If the surface does not already carry a Netpage tag pattern 3, thenprinting proceeds as follows:

On the first swipe following initiation of printing, the swipe printer100 prints an appropriate portion of the image as the swipe proceeds.Since it has no absolute reference to begin with, the swipe printer 100assumes, for example, that the user is swiping from left to right on theunderlying page. The assumed swipe orientation can be set as a userpreference and it will be understood that any arbitary initial swipedirection may be assumed.

As well as printing the image portion, the swipe printer 100 also printsa Netpage tag pattern 3 as it proceeds. It uses the tag sensor 120,located downstream of the printhead 110, to sense its own location andorientation relative to the tag pattern 3 it has just printed. In otherwords, the printhead 110 leaves a trail (or “wake”) of tags 4, which canbe imaged by the tag sensor 120. This allows the printhead to accuratelyprint the image portion and tag pattern 3.

On subsequent swipes the swipe printer 100 prints additional portions ofthe image until the entire image has been transferred to the surface,but it only starts printing each subsequent image portion when itsenses, via the tag sensor 120, a portion of the tag pattern 3 printedduring an earlier swipe. The user is therefore obliged to print theimage using outward swipes from an already-printed image portion.

The position-coding pattern 3 also contains an encoded impression ID,which can be associated with the graphic image being printed. Theprinter 100 may contain a plurality of ‘spare’ impression IDs in amemory, each of which can be allotted to graphic images printed by theprinter. Alternatively, the printer 100 may receive an impression IDfrom the Netpage server 10 via its communications module 154. Hence, anygraphic image printed by the swipe printer 100 can be interactive in thefull Netpage sense, since a Netpage reader 400 can, on a subsequentinteraction with the surface, identify the image via the impression IDas well as its own absolute location.

In order to generate interactive Netpages in this way, the swipe printertypically communicates association data to the Netpage server 10 via itscommunications module 154, which allows the server to create a pagedescription 5 corresponding to the newly printed image. The associationdata indicates an association between the graphic image, the impressionID and the plurality of absolute positions identified by theposition-coding pattern 3.

The swipe printer may include an additional motion sensor, such as anoptical mouse style sensor, to obtain a relative motion signal sampledat a higher rate than the absolute motion signal of the tag sensor 120(see U.S. application Ser. No. 12/015,507 filed on Jan. 17, 2008, thecontents of which is herein incorporated by reference). As described inU.S. application Ser. No. 12/015,507, the motion sensor may be in theform of an optical mouse, which utilizes the tag image sensor to obtainimages of the surface. The swipe printer 100 can combine the two signalsto obtain a more precise absolute motion signal.

2.3 Swipe Scanner

The swipe printer may also incorporate a linear image sensor 160 (e.g.CCD or CMOS) for scanning an image from a surface, either in monochromeor colour. The image sensor is ideally configured parallel to andcoextensive with the printhead 110, so that a printing swipe and ascanning swipe are equivalent. The linear image sensor may also beincorporated in the printhead itself, as described in U.S. Pat. No.7,140,792, the contents of which is herein incorporated by reference.For convenience, swipe printers comprising a linear image sensor of thistype are termed ‘swipe scanners’.

If the surface is not tagged then the swipe printer can print a tagpattern 3 onto the surface as it proceeds in order to provide itselfwith an absolute position reference. This absolute position referenceallows the plurality of successive images captured by the linear imagesensor 160 to be assembled accurately into a scanned graphic image.

The printhead 100 can either transfer the tag pattern 3 onto the surfaceprior to scanning an image within the tagged area, or it can transferthe tag pattern to the surface while it scans, in direct analogy withthe way it prints an image onto an un-tagged surface. In this case theuser is obliged to swipe outwards from the tagged region where scanningwas initiated.

On the first swipe of an untagged surface, there is a time delay betweenthe start of printing and when the tag sensor 120 first sees a valid tagpattern. This time delay is the product of the swipe speed and thedistance between the printhead 110 and the far edge of the tag sensor120. One or more relative motion sensors can be used to ensure properregistration during this time interval. Using two relative motionsensors rather than just one allows rotation information to be moreeasily recovered. Of course, in the robotic swipe scanner, the swipespeed will be known and motion sensors may not be required to determinethe swipe speed.

The Netpage tag sensor 120 can be used as a relative motion sensor inthe absence of a tag pattern, using inter-frame surface texturecorrelation in the same way as an optical mouse.

If the surface is tagged then there are two ways the swipe printer canscan the image. It can use surface identity to look up the correspondingpage description 5 on a Netpage server 10, and use the location toextract a portion of the page description. Alternatively, it can scanportions of the image directly from the surface during one or moreswipes, and combine them in direct analogy with the way it prints animage onto the surface during one or more swipes.

2.3.1 Conferring Interactivity on Pre-Printed Graphic Images

As explained above, the swipe scanner may be used to scan a pre-printedgraphic image and print a position-coding pattern onto the image. Inthis way, the swipe-scanner, together with the Netpage server 10, may beconfigured to confer interactivity on the pre-printed graphic image byanalogy with the swipe printer.

The position-coding pattern 3, printed by the swipe-scanner, contains anencoded impression ID, which may be associated with the graphic imagebeing scanned by the scanner. The scanner 100 may contain a plurality of‘spare’ impression IDs in a memory, each of which can be allotted tographic images scanned by the scanner. Alternatively, the scanner mayreceive an impression ID from the Netpage server 10 via itscommunications module 154. Hence, any pre-printed graphic image scannedby the swipe scanner may be made interactive in the full Netpage sense,since a Netpage reader 400 can, on a subsequent interaction with thesurface, identify the image via the impression ID as well as its ownabsolute location.

In order to generate interactive Netpages in this way, the swipe scannertypically communicates association data to the Netpage server 10 via itscommunications module 154, which allows the server to create a pagedescription 5 corresponding to the scanned graphic image. Theassociation data indicates an association between the scanned graphicimage, the impression ID and the plurality of absolute positionsidentified by the position-coding pattern 3.

Interactive elements may be manually associated with zones of thescanned graphic image by a user. For example, hyperlink zones containedin the scanned graphic image may be associated with corresponding URIsby a user and stored as part of the page description 5 for the graphicimage. Likewise, input field zones (e.g. text entry fields) may beassociated with corresponding input fields in the page description.

2.3.2 Automatically Conferring Interactivity on Pre-Printed GraphicImages

As an alternative to manually associating interactive elements withzones of the graphic image, the Netpage server 10 may use OpticalCharacter Recognition (OCR) to confer interactivity automatically andwithout user intervention. For example, OCR may be used to identify URItext strings, and hence URIs, (e.g. www.example.com) in the scannedgraphic image. The Netpage server 10 can then generate automatically aninput description for the scanned graphic image. The input descriptionmay describe a zone of the URI text string in the scanned graphic imageand its corresponding URI. This input description, together with thescanned graphic image, is stored as the page description 5 for thepre-printed graphic image. Hence, scanning/printing of pre-printedgraphic images can allow automatic Netpage hyperlinking from the printedpage, even though the graphic image as originally printed had no suchinteractivity.

Even if the scanned graphic image does not contain any identifiable URItext strings, OCR technology may still be used to confer usefulinteractivity on the printed graphic image. As described in theApplicant's copending US Publication No. 2007/0146322 (the contents ofwhich is herein incorporated by reference), text-based keyword searchesand copy/paste operations may be initiated from printed substrates, andstill enable users to receive useful information in the absence ofexplicit hyperlink zones on the page.

Thus, using OCR technology, text images in the scanned graphic image maybe converted into computer text (e.g. Unicode, ASCII etc), and thecomputer text stored as part of the input description for thepre-printed graphic image. Typically, the input description describeswords of computer text and zones of corresponding text images in thescanned graphic image. The zones may be described explicitly withreference to coordinate positions, or they may be inferred from thecomputer text using one or more of: a length of a word, a point size,and a position of the word in the computer text. Likewise, the zones ofURI text strings may be inferred in the same way.

The corresponding page description 5 comprises the scanned graphic imageand the input description for that graphic image. Of course, the inputdescription may describe URIs, as described above, as well as computertext.

With the page description storing computer text in this way, text-basedsearching may proceed similarly to the method described in USPublication No. 2007/0146322. For example, a user may interact with aprinted word (or words) of text using a Netpage reader 400 and read partof the position-coding pattern 3 (e.g one or more tags 4). Interactiondata, identifying the impression identity and a position, is sent fromthe Netpage reader 400 to the Netpage server 10 in the usual way. Theimpression identity is used to retrieve the corresponding pagedescription 5 and identify the word(s) of text using the position(s) ofthe reader. A search query is generated, which contains one or morekeywords. The search query typically contains one or more of the wordsindicated by the Netpage reader interaction, and may additionallycontain contextual keywords, identified using the page description 5, inorder to enhance the search. Contextual keywords may, for example, bederived from a sentence or paragraph containing the indicated word(s). Amore detailed description of contextualized Netpage searching may befound in the Applicant's copending US Publication No. 2007/0146322.

With the search query generated, the Netpage server 10 initiates asearch using, for example, an Internet keyword search engine (e.g.Google, Yahoo!, Wikipedia etc). The Netpage server 10 may initiate thesearch directly by sending a request URI to a search engine, or it maysimply send the request URI to the user's web browser, which can thenperform the search. Suitable Netpage architectures for initiating suchsearches are described in US Publication No. 2007/0146322. Finally, theuser receives the search results, typically in the form of a webpagecontaining the search results.

Page descriptions describing computer text may also be used to initiatetext-based copy/paste operations via the printed graphic image, as alsodescribed in US Publication No. 2007/0146322. In this scenario,interaction data is sent from the Netpage reader 400 to the Netpageserver 10 in the usual way and the page description 5 is used toidentify word(s) of computer text, which are then copied to a clipboard.Of course, the contents of the clipboard may be subsequently pasted to asuitable application.

Image-based copy/paste operations may, of course, be performed withoutOCR of the scanned graphic image. Thus, an image may be selected by, forexample, a lasso gesture of the Netpage reader 400 and copied to aclipboard. The selected image is identified with reference to the pagedescription, which, in this case may, simply describe the scannedgraphic image without any explicit description of computer text orinteractive zones. Nevertheless, subsequent OCR on the image-clippingstored in the clipboard may be used to generate corresponding computertext, which can be subsequently pasted into an application.

In connection with the above, it will be understood that hyperlinks andcomputer text may be discovered “lazily” by the Netpage server 10. Inother words, when the user actually clicks on a location on a page, theserver can determine if the click coincides with word(s) of text and/orthe zone of a URI text string by performing OCR on-demand on at leastpart of the scanned graphic image described in the page description.

Text-based searching, text-based copy/paste operations and hyperlinkingmay each be distinguished via the Netpage reader 400 and/or the Netpageserver 10. For example, a gesture (e.g. lasso, swipe, underline, clicketc) or mode selection may be used to distinguish different types ofinteraction, as described in detail in US Publication No. 2007/0146322.

2.4 Other Netpage Scanners for Automatically Conferring Interactivity onPre-Printed Graphic Images

As described above in Sections 2.3.1 and 2.3.2, Netpage interactivitymay be conferred on pre-printed graphic images using the swipe scanner100, which typically prints the position-coding pattern 3 at the sametime as swipe-scanning the pre-printed graphic image. A number ofalternative systems for conferring interactivity on pre-printed graphicimages may be also be used, as described below.

2.4.1 Modified Netpage Printer

Netpage printers, which are configured for substantially simultaneousprinting of graphic images and a position-coding pattern 3 are describedin, for example, U.S. Pat. Nos. 7,233,320, 6,727,996 & 6,870,966, thecontents of which are herein incorporated by reference. In the Netpageprinter described previously by the present Applicant, the printerreceives a visual description for a graphic image together with a pageidentity from the Netpage server 10. The printer generates CMYK dot datafor the graphic image and simultaneously generates IR dot data for theposition-coding pattern 3. A stationary pagewidth printhead in theNetpage printer has a dedicated IR channel for printing theposition-coding pattern 3 as well as the usual CMYK color channels.Hence, the Netpage printer is capable of simultaneously printing graphicimages with the position-coding pattern 3 so as to create an interactivenetpage 1.

Netpage printers may be modified to include a linear image sensor(typically a stationary pagewidth scanhead) in order to confer Netpageinteractivity on graphic images in a similar way to the swipe scannerdescribed above in Section 2.3. The skilled person will readilyappreciate how such printers may be modified to include a pagewidthscanhead, which may be positioned, for example, adjacent a pagewidthprinthead in the printer.

Netpage printers modified with a pagewidth scanhead have the advantagethat any page received by the printer, which bears a pre-printed graphicimage, may be tiled with the position-coding pattern and simultaneouslyscanned by the scanhead so as to confer Netpage interactivity on thepage. Moreover, since a timing relationship between the printhead andthe scanhead is fixed (by virtue of a common paper feed mechanism),accurate registration between the scanned image and the position-codingpattern 3 is ensured.

FIG. 7 shows schematically a modified Netpage printer 200 having aprinthead assembly 201, which includes a pagewidth printhead 210 forprinting the position-coding pattern 3 onto a print medium 205, and apagewidth scanhead 220 for scanning pre-printed graphic images on theprint medium. As shown in FIG. 7, the scanhead 220 is positioneddownstream of the printhead in the sense that scanning occurs afterprinting. However, the scanhead 220 may alternatively be positionedupstream of the printhead, since the timing relationship betweenprinting and scanning is fixed by the feed mechanism 230. The feedmechanism 230 feeds print media 205, bearing pre-printed graphic images,past the printhead 210 and scanhead 220 at a known constant speed.

In addition, the printhead assembly 201 may include a tag image sensor225, positioned downstream of the printhead 210 and upstream of thescanhead 220, which reads part of the position-coding pattern 3immediately after it is printed by the printhead. By analogy with theswipe-scanner 100, the tag image sensor 225 may be used to provide thebest possible registration between the scanned image and theposition-coding coding pattern 3, even though registration is achievablefrom the known speed of the print medium 205.

By further analogy with the swipe scanner 100, the modified Netpageprinter 200 may allocate an impression ID to each scanned page from astore of impression IDs contained in the printer or from a serverallocating impression IDs on-demand. The impression ID is encoded intothe position-coding pattern 3, which is printed by the printer duringscanning. Likewise, the printer may generate association data for eachscanning/printing job and communicate this association data to theNetpage server 10. The association data indicates an association betweenthe scanned graphic image, the impression ID and the plurality ofabsolute positions identified by the position-coding pattern 3. Thisenables the Netpage server 10 to generate a page description 5 for thescanned graphic image, optionally using OCR to identify text stringsand/or hyperlinks, as described above.

2.4.2 Modified Flatbed Scanner

Flatbed scanners are well-known devices used to scan pre-printed graphicimages and convert the scanned image into a digital image. The digitalimage may be saved to a user's desktop in a suitable format e.g. pdf. Ina typical flatbed scanner, a page bearing a graphic image is placedfaced down on a glass platen and a pagewidth scanhead, mounted on acarriage, traverses across the page and scans the image. The page istypically illuminated through the glass platen using any suitable lightsource.

A flatbed scanner may be modified to include a printhead, which printsthe position-coding pattern 3 onto the pre-printed graphic image duringscanning. Referring to FIG. 8, there is shown a modified flatbed scanner300 comprising a platen 305, on which is placed a print medium 205bearing a pre-printed graphic image. A traversing carriage 310 has apagewidth printhead 210 and a pagewidth scanhead 220 mounted thereon. Asthe carriage 310 traverses across the print medium 205 in the directionof the arrow, the position-coding pattern 3 is printed onto the printmedium by the printhead 210, and the graphic image is scanned by thescanhead 220. Of course, a non-printing mode is equally possible, inwhich case the scanner 300 functions as conventional flatbed scanner.Typically, the carriage 310 incorporates an ink supply (e.g. inkjet inkor toner supply for the printhead 210).

The scanner 300 has a processor (which may be contained in the carriage310) configured to generate association data by analogy with both theswipe scanner 100 and the modified Netpage printer 200 described above.Since the carriage 310 moves at a known constant speed, registrationbetween the position-coding pattern 3 and the scanned graphic image isgenerally ensured. However, the carriage 310 may also have a tag imagesensor 225 mounted thereon, positioned downstream of the printhead 210,for reading the part of the position-coding pattern 3 just printed bythe printhead during a traverse of the carriage 310. By reading theposition-coding pattern 3 with the tag image sensor 225, the bestpossible registration between the scanned image and position-codingpattern can be achieved.

2.4.3 Printing a Position-Coding Pattern onto Graphic Image withSubsequent Scanning

In each of the swipe scanner 100, the modified Netpage printer 200 andthe modified flatbed scanner 300 described above, the respective deviceprints the position-coding pattern 3 and scans the graphic image atsubstantially the same time. Once the position-coding pattern 3 isprinted and the scanned image acquired, the device generates associationdata indicating an association between the scanned graphic image, animpression ID allocated to the scanned image and the plurality ofabsolute positions identified by the position-coding pattern 3. Thisassociation data is communicated to the Netpage server 10, enablingcreation of a page description 5, optionally in combination with OCRtechniques to enhance the degree of Netpage interactivity achievablewith the printed page.

In an alternative scenario, the Netpage printer (as described in, forexample, U.S. Pat. Nos. 7,233,320, 6,727,996 & 6,870,966) may beconfigured to print in a ‘tag-only’ mode. In this mode, the printerallocates an impression ID to a page (either from an internal supply of‘spare’ impression IDs or on request from the Netpage server 10) andsimply prints the position-coding pattern 3 via its IR channel onto apre-printed graphic image. The user may manually select a ‘tag-only’mode if the printer is receiving print media bearing pre-printed graphicimages, which are desired to acquire Netpage interactivity.

It should be noted that, unlike the usual printing mode of the Netpageprinter, in the ‘tag-only’ mode, the printer does not generally printany graphic images via its CMYK channels, although the page may bevisibly marked to indicate that the position-coding pattern 3 has beenprinted, particularly if the pattern is invisible to the naked eye.Moreover, the standard Netpage printer is not equipped with the scanhead220, described in Section 2.4.1, and so no scanning of the pre-printedgraphic images can occur.

At the time of printing the position-coding pattern 3 in ‘tag-only’mode, the impression ID encoded into the position-coding pattern 3 istypically ‘unknown’ to the Netpage server 10 in the sense that it hasnot yet been associated with a visual description of the pre-printedgraphic image e.g. a scanned digital version of the pre-printed graphicimage. Hence, the resultant substrate, having the graphic image and theposition-coding pattern 3, will not be interactive immediately afterprinting in ‘tag-only’ mode, because the impression ID does not have acorresponding page description 5 stored in the Netpage server 10.

Substrates which have been printed in ‘tag-only’ mode may be madeinteractive by a suitable Netpage scanner. By way of example, a flatbedNetpage scanner 350 is shown in FIG. 9, although the swipe scanner 100configured for reading a tagged surface (described in Section 2.3) mayequally be used.

The flatbed Netpage scanner 350 typically comprises a carriage 410 onwhich is mounted a pagewidth scanhead 220 and a tag image sensor 225 forreading part of the position-coding pattern 3. In use, a substrate 401having the graphic image and the position-coding pattern 3 is placed ona platen 405, and the carriage 410 traverses across the substrate 401 asshown in FIG. 9. During traversal of the carriage 410, the tag imagesensor 225 reads part of the position-coding pattern 3 whilst thescanhead 220 scans the graphic image. The tag image sensor 225 may beintegrated with the printhead, as described in US Publication No.2005/0219299, the contents of which is herein incorporated by reference.

After scanning, the Netpage scanner 350 can then generate associationdata indicating an association between the impression ID (as read fromthe position-coding pattern 3), the plurality of absolute positions andthe scanned graphic image. The association data is generated by asuitably configured processor, which may, for example, be contained inthe carriage 410.

The association data is then communicated to the Netpage server 10,which can create a page description 5 in the usual way. Although inFIGS. 8 and 9, the position-coding pattern 3 is shown as a grid of dotsfor clarity, this position-coding pattern would, in practice, be printedwith an IR-absorbing ink, which is typically invisible or hardly visibleto the naked eye.

Of course, conventional inkjet printers incorporating flatbed scannersare well known in the art. Similarly, a Netpage printer may incorporatethe flatbed Netpage scanner 350 to provide a highly versatile device,which can perform all the usual functions of the Netpage printer, aswell as enabling Netpage interactivity to be conferred on pre-printedgraphic images via ‘tag-only’ printing and subsequent Netpage scanningas described above.

The Netpage scanner 350 may also be useful if the position-codingpattern 3 encodes an impression ID, which is known to the Netpage server10 and for which a corresponding page description 5 already exists. Byscanning the graphic image, reading the impression ID and retrieving thecorresponding page description 5, a comparison between the visualdescription (stored in the page description 5) and the scanned graphicimage (acquired by the Netpage scanner 350) may be made by the Netpageserver 10. Based on this comparison, the Netpage server 10 can determineif, for example, the graphic image has been annotated and then,optionally, store these annotations as a separate layer with the visualdescription of the page. This is particularly useful if the page hasbeen annotated using a normal (i.e. non-Netpage) marking pen, meaningthat the annotations would be unknown to the Netpage server 10. Asimilar means for determining pen annotations was described by thepresent Applicant in U.S. Pat. No. 7,110,126, the contents of which isherein incorporated by reference.

2.4.4 Adhering a Position-Coding Pattern onto Graphic Image withSubsequent Scanning

As an alternative to printing the position-coding pattern 3 in‘tag-only’ mode, a substrate having a pre-printed graphic image may havea transparency 500 with an adhesive backing attached thereto. Theadhesive transparency 500 carries a position-coding pattern 3, whichencodes an impression ID together with a plurality of absolutepositions. A plurality of transparencies 500 may be manufactured, eachhaving its own unique ‘blank’ impression ID, which can be subsequentlyassociated with a page or graphic image.

Once the transparency 500 is adhered to a substrate having a pre-printedgraphic image, the substrate may be scanned using, for example, theNetpage flatbed scanner 350 or the swipe scanner 100, enabling thecreation of a corresponding page description 5. The Netpage scanner 350treats the substrate-transparency assembly in exactly the same way asthe tagged substrate 401, where the impression ID is unknown to theNetpage server 10, as described above in Section 2.4.3.

Transparencies of this type may be useful in situations where asubstrate cannot be easily fed through a Netpage printer e.g. somenon-paper substrates, bound pages of book etc. The transparency may beeither permanently or removably attached to the substrate.

The present invention has been described with reference to a preferredembodiment and number of specific alternative embodiments. However, itwill be appreciated by those skilled in the relevant fields that anumber of other embodiments, differing from those specificallydescribed, will also fall within the spirit and scope of the presentinvention. Accordingly, it will be understood that the invention is notintended to be limited to the specific embodiments described in thepresent specification, including documents incorporated bycross-reference as appropriate. The scope of the invention is onlylimited by the attached claims.

1. A method of printing comprising the steps of: (i) operativelypositioning a swipe printer relative to a surface and swiping theprinter across the surface; (ii) printing, during said swipe, successiveparts of a position-coding pattern onto said surface; (iii) printing,during said swipe, successive parts of a graphic image onto the surface,said position-coding pattern and said graphic image being superimposed;(iv) imaging, during said swipe, portions of said surface on which saidprinthead has printed said parts of the position-coding pattern; (v)determining, during said swipe, absolute positions of the printheadusing imaged parts of the position-coding pattern; and (vi) using theabsolute positions to control, during said swipe, printing of theposition-coding pattern and the graphic image.
 2. The method of claim 1,wherein said printhead prints the graphic image and the position-codingpattern substantially simultaneously onto said surface.
 3. The method ofclaim 1, wherein said surface is blank in step (i), and wherein aninitial position of said swipe printer provides a reference point forsaid position-coding pattern.
 4. The method of claim 3, wherein saidreference point is an origin.
 5. The method of claim 4, wherein saidorigin is based on an assumed initial swipe direction in step (i). 6.The method of claim 5, wherein said origin is a top-left corner of theposition-coding pattern, and said initial swipe direction is aleft-to-right swipe or a top-to-down swipe.
 7. The method of claim 1,wherein step (i) further comprises the sub-steps of: imaging part of aposition-coding pattern printed during a previous swipe of the printer;and determining an absolute position of the printhead, wherein saidimaged part of the position-coding pattern is contained in an outerperimeter of the position-coding pattern printed during the previousswipe.
 8. The method of claim 7, wherein said swiping comprises swipingoutwardly from said outer perimeter.
 9. The method of claim 1, whereinsaid graphic image is printed with at least one first ink and saidposition-coding pattern is printed with a second ink.
 10. The method ofclaim 9, wherein said second ink is an infrared-absorbing ink.
 11. Themethod of claim 1, wherein said printer is configured for unidirectionalswiping.
 12. The method of claim 11, wherein said printer comprises afirst image sensor for imaging said position-coding pattern, said firstimage sensor being positioned downstream of a printhead, wherein a swipedirection is defined as upstream.
 13. The method of claim 1, furthercomprising the steps of: sensing relative motion of the printer duringthe swipe to generate relative motion data; and using the sensedrelative motion together with said absolute positions to controlprinting of the position-coding pattern and the graphic image.
 14. Themethod of claim 1, further comprising the steps of: sensing anorientation of the printer relative to the position-coding pattern;using the orientation together with said absolute positions to controlprinting of the position-coding pattern and the graphic image.
 15. Themethod of claim 1, further comprising the steps of: accessing animpression identity for said graphic image; associating said impressionidentity with said graphic image; generating association data indicatingan association between the impression identity, the absolute positionsand the graphic image; and communicating said association data to acomputer system.
 16. The method of claim 15, wherein the printedposition-coding pattern further identifies said impression identity. 17.The method of claim 15, wherein said association data enables saidcomputer system to associate one or more zones of the graphic image witha corresponding interactive element.
 18. The method of claim 16, whereinsaid interactive element is selected from the group comprising: ahyperlink, an input field and a button.
 19. The method of claim 15,wherein said impression identity is accessed from any one of: a memoryin said printer, said memory storing a plurality of impressionidentities; and a computer system communicating with said printer. 20.The method of claim 1, wherein said printer is contained in a mobilephone or personal digital assistant.